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BACKGROUND OF INVENTION 
Field of the Invention 

The invention relates to a precise and automatic matching method for two sets 
of planar point patterns, especially to the auto matching method and the ap- 
plication thereof such as biometric system. 



Description of the Related Art 

Methods for identifying two or more sets of planar points pattern become a 
more popular topic in science and technology. The primary goal of these meth- 
ods using digital system is to distinguish whether two or more planar point 
patterns are similar or not. The fields of applications directly related to these 
methods include computer vision and image processing. An example of these 
applications is recognition of hand-written characters such as OCR (Optical 
character recognition), and another good example is the biometrics, which use 
the physical or behavioral characters of human to achieve personal ID identify. 
Since the advent of Internet, through Internet, fingerprints and iris identifica- 
tion methods, have been provided to support electrical commerce, information 
security, on-line order and payment, or credit card service. In addition, these 
technologies also support off-line system, security control of automobile lock, 
and the launching for engine system. The prior art matching methods for the 
planar points, such as Fuzzy relaxation, and point-to-line voting, for example, 
U.S. Patent No.5, 392,367, No.5, 974,176,and No.5, 991,430, are conducted in 
six matching procedures. The first is to abstract the input parameters of all the 
points. The second is to precede the coarse-matching to filter out the impossible 
matched pairs by means of the distance and angle between points. The third 
is to use either Fuzzy relaxation or point-to-line voting method to find out the 
four most possible matched pairs. The fourth is to determine the rotation and 
translation of these two sets of planar points from four most possible matched 
pairs mentioned by the third procedure. The fifth is to convert the coordinates 
and to find the summation of distance. And the sixth is to use the summation 



of distance from the fifth procedure to calculate the similarity. However, nei- 
ther Ftizzy relaxation method nor Point-to-line method can determine the four 
most matched pairs rigid enough. Once the first of the four matched pairs are 
selected mistakenly, these methods will give a totally unexpected result due to 
incorrect rotation and translation. According to the drawback of the prior art, 
the invention further provides a method, triangle-matching method, which can 
overcome the drawback of the prior art described. 

SUMMARY OF THE INVENTION 

The invention refers to the Huber Space Telescope matching method, 
using the triangular elements to determine the translation and rota- 
tion of the coordinates between the images of starts and the database. 
But the invention further improves the Huber Space Telescope method 
because of only by the side of a triangle, not by the entire triangle 
like the Huber Space Telescope method, to determine the geometri- 
cal information. The invention comprises of the following steps: 

(a) Generate the triangular element matrices; generate a list of all 
the possible sides of a triangle basing on the vertices of the others 
triangle and 12 geometrical parameters stored in two matrices such 
as Ti and Tn> wherein the subscripts I and R individually represent 
the input and reference. According to the 12 geometrical parameters 
stored in these matrices, one can confirm the first four matched pairs. 
As a result, this step can considerably reduce the possibility of wrong 
selection. 

(b) Generate matching-related flag matrix such as FM; the two 
point patterns sets p and q can be related to each other under the 
following conditions, 

\x p -x g \<X & \v P ~y q \<Y & |0p-0 g |<0, 

, wherein subscripts p and q represent the coordinate and the char- 
acteristic angle 6 in the input test set P and the reference set Q. 
Further X, Y are the tolerances of the differences of the position. 0 
is the tolerance of the difference of characteristic angle between these 
two sets. If all the conditions are satisfied, then set flag fm\pq] = 1. 
wherein fm\pq] is the element of the Martix FM 

(c) Determine the triangle weighting value in combination with the 
triangle coarse matching thereof; THangle weighting value has two 
benefits: one is to find the tendency of direction about the triangular 
elements, the other is to determine the shift and rotation parameters. 
Before this procedure, there is an apriority value, fm\pq] , needs 
to be verified. If fm\pq] = 1 , then go on with triangle coarse 
matching. Triangle coarse matching, in which the propose is to 
filter out the impossible mated points of triangle elements according 



to their geometrical parameter in the input set P and reference set Q. 
Set the several conditions to determine whether a triangle element 
from pattern P and a triangle element from pattern Q are definitely 
mated or not: 

\Tj(h) - T R (h)\ < Lk\Tj{h) - T R {h)\ < L 

IIMAi) - 2VA0I < A&|Tj(A 2 ) - T R (\ 2 )\ < A 

&|2j(A3) -Tr(A3)| < A; 
127(00 - < 0&|:Z>(0 2 ) - T R (9 2 )\ < 0 

&\T I {d 3 )-T R (8 3 )\<®; 

|T/(aO - IMcn)} < Ak\Tj(a 2 ) - T H (a 2 )| < A 

k\Tj{a 3 )-T R (a 3 )\<A, 

wherein the subscripts 1, 2, 3 represent the vertices of a triangle and 
L, A, 0 and A are the thresholds. 

If the geometric parameters do not satisfy any of the conditions, 
then we can discard those elements that are impossible mated and 
the information about those elements will not go to determine the 
triangle weighting value. However, once a pair of triangles meets all 
the conditions, then the direction of a triangle element, such as D, 
can be defined as the average of the difference between input J and 
reference R angles: 

n _ pV (on) - T R (a t )\ + \T r (a 2 ) - T R {a 2 )\ + - T R (a 3 )\ 

~~ 3 ' 

where the angles a^are between each side of a triangle and the X — 
axis. 

The weight of all the possible matched pairs of triangle elements is: 

N p N p N p N g N q N q 

W(D m ) =££EE££[ L - (\Tdhi) - T R {l r8 )\)+ 

i—1 j=l fe=l r— 1 8—1 t=l 

L - (IT/fe) - T R (l H )\) +L- {\Tj(l jk ) - T R (l 8t )% 

where Tj and T R are the matched number of points in the input set 
and the reference set respectively, and L is the threshold of length. 

(d) Convert the coordinate; to convert a set of the points to the 
new coordinate needs to determine four parameters, which can be 
derived from the four most matched pairs in the highest weighting 
value direction i.e. for every m , W(Dh) = max{W(D m )} 
(m = 1, 2, ...n), , Where the angle depending on the weighting value 
thereof is introduced in the step(c). Use the four most matched pairs 



to determine the rotation and translation parameters of coordinate, 
in which convert the set of the points to the new coordinate: 

" NewX ] _ r h ] f n -r 2 1 [ X ] 
_ NewY J " [ h J + [ r 2 r 2 J [ F J ' 

where *i and £2 are the translation parameters, ri and are the 
rotation parameters. After finding these four parameters, the coor- 
dinate can be converted into the new one. 

(e) Calculate the similarity; the similarity is determined by the com- 
binations of the weighting value such as W and the number of match- 
ing points such as N, the average of the distance between each cor- 
rectional new points of one set and corresponding points of another 
set. The similarity, such as {Sim), is simply a algebra function of 
weighting value such as (W). Inverse of the average distance (^), 
number of matching pairs (iV m ),the number of points in input set 
(iVp)and the number of points in reference set {N q ). Therefore, it 

is defined as,Sim = J^ff , which can be completed the triangle 
matching method of the invention. 



BRIEF DESCRIPTION OF THE DRAWINGS 

The following detailed description, given by way of examples and not intended to 
limit the invention to the embodiment described herein, will best be understood 
in conjunction with the accompanying drawings, in which: 

FIG.l illustrates the flow chart diagram of the invention; 
FIG.2 illustrates the details of the flow chart of FIG.l; 

FIG.3 illustrates a schematic diagram for the specific 12 geometrical parame- 
ters of the invention; 

FIG.4 illustrates a schematic diagram of the characteristic angle D c ,using sym- 
bol 9 presents in this figure; 

FIG.5a-d illustrates tables of the points and their feature direction in X — Y 
coordinates of two pair of patterns, where one pair of patterns is similar 
and another is not; 

FIG.6a-d illustrates tables or diagrams of the position of two pairs of set in 
two-dimension space, where one pair of points is similar and another is 
not; 

FIGS.7a-h illustrates the tables or diagrams of results of the two pair of planar 
points patterns after triangle coarse matching; 



FXG3.8a-d illustrates tables or diagrams of the results after converting coor- 
dinate process alter; 



FIGS.9a-d illustrates the diagrams of the positions of similar or non-similar 
test pattern; and 

FIG.10 illustrates a diagram of FAR/FRR. 

DETAIL DESCRIPTION OF THE INVENTION 

Referring to FIG.l, which illustrates the flow chart 100 of the invention; in the 
step 101 and 102, generate a list of all the possible sides of a triangle based on 
the vertices of each triangle and store all the 12 geometrical parameters in the 
two matrices such as Tj and T Ry wherein the subscript I and R individually 
represent the input and reference. According to the 12 geometrical parameters 
stored in these matrices, which one can confirm the first four matched pairs, 
as a result, which can considerably reduce the possibility of wrong selection. 
In addition, by generating matching-related flag matrix such as Fm, the two 
point patterns sets p and q can be related to each other under the following 
conditions, as shown in Fig.3, 

\x p -z q \<X k \Vp-Vq\<Y k \0 v -9 q \<Q, (1) 

wherein subscripts p and q represent the coordinate and the characteristic 
angle ,as shown in Fig.4, which illustrates the characteristic angle ,using symbol 
6 to represent in this figure, in the input test set P and the reference set Q. 
further -X", Y are the tolerances of the differences of the position while 0 is the 
tolerance of the differences of characteristic angle between these two sets. If all 
the conditions are satisfied, then set flag fm\pq] = 1. In the step 103 and 104, 
determine the triangle weighting value combined with triangle coarse matching; 
Before processing this procedure, there is an apriority value needs to be verified. 
If frn\pq] = 1, then go on with triangle coarse matching, i.e. : 

Vfm\pq],peP,q£Q: 

fm\pq] = 1. (2) 

Triangle coarse matching, in which the propose is to filter out the impossible 
mated points of triangle elements according to their geometrical parameter in 
the input set P and reference set Q. Set the several conditions to determine 
whether a triangle element from pattern P and a triangle element from pattern 
Q are definitely mated or not: 

\Wi) - T R (h)\ <L k \Tj(l 2 ) - T R (l 2 )\ < L k \Ttih) - T R (h)\ < L 

\Tj(\i) - 7ji(Ai)| < A k ITj^-TniX^KA k iTr(A 3 ) - T R (X^)\ < A 

iW-WI<Q & \Ti(#2) - T R ($ 2 )\ < & k |T/(ft)-Ta(fc)|<e 

\T I (a 1 )~T R (a l )\<A k frfa) -T R (a 2 )\ < A k |2>(a 3 ) - T R (a 3 )\ < A 

where £, A, 0 and A are the thresholds, and the internal angles can be 
computed by: 



Ai — ?r — (a 2 — 03) 
A 2 = 7r - (0:3 - at) 

A 3 = 7r-(ai-a 2 ). (4) 

If the geometric parameters do not satisfy any of the conditions, then we can 
discard those elements that are impossible mated and the information about 
those elements will not go to determine the triangle weighting value. However, 
once a pair of triangles meets all the conditions, then the direction of a triangle 
element- D can be defined as the average of the difference between input J and 
reference R angles: 

D = F*M ~ + Z + 1 7 ^) - T R (as)\ (g) 

3 

It's an average effect of the three angles that between each side of the triangle 
and the X - axis. Li order to decide the tendency of the direction of these 
triangular elements, dividing the plane space into n equal sectors: £>i, Z?2>— A»- 
By statistic point of view, if there is a rotating effect between the input test 
and reference triangular elements, this effect will apparent in a sector among 
one of the Du D^.D n . In other words, we use the histogram of the directions 
to decide the tendency, somewhat like windrose diagram which often use in 
meteorology. For each direction D m (ra = l,2,...n), the weighting of all the 
possible matched pairs of triangle elements is: 

N p N p N p N q N q N q 

w(D m ) =£££££££- (ph%) - ft <ui)+ 

i=l j=l r=l &=1 t=l 

l - m{i ik ) - T R M\) +l- (\m jh ) - t r (um. (6) 

Where Tj and Tr are the the input test matrix and the reference matrix 
respectively, and L is the threshold of length in (3). 

Continuously, In the step 105, Converting the coordinate; to convert a set of 
the points to the new coordinate needs to determine four parameters, of which 
the coordinates of the four most matched pairs in the highest weighting value 
direction , i.e. 

Vm, W(D h ) = max{W(D m )} (7) 

(m = 1, 2, ...n) , where the angle depending on the weighting value W(D) is 
introduced in the step 104. Using the four most matched pairs to determine the 
rotation and translation parameters of coordinate, in which convert a set of the 
points to the new coordinate: 

' NewX 
NewY 



h 



+ 



n -r 2 



X 
Y 



(8) 



where h and i 2 are the translation parameters, r\ and r 2 are the rotation 
parameters. 

After finding these four parameters, the coordinate can be converted into 
the new one. After coordinate converting, one can find the average distance (S) 
between the points of new set (X# ew ,Ypf ew ) and the corresponding points of 
the reference set (X re f,Y re f): 

b _ _ _ - — . (V) 

where N m is number of the matched points. Finally, In the step 106, Calcu- 
lating the similarity; the similarity is determined by the combinations of the 
weighting value such as (W) and the number of matching points such as (iV m ), 
the average of the distance between each correctional new points of one set and 
corresponding points of another set. The similarity such as (Sim) is simply a 
algebra function of weighting value (W), Inverse of the average distance (|), 
number of matching pairs (JV m ), (JV p )-the number of points in input set and 
(iV g )-the number of points in reference set. Therefore, it is defined as: 

WN 2 

which can be completed the triangle matching method of the invention.Referring 
to FIG.2, which further illustrates the flow chart of the FIG.l; the step 200 and 
step 201 are included into the Step 102 of the Fig.l. The step 202 is included 
into the step 104 of the Fig.l. And the steps from 203 to 207 are included 
into the step 106 of Fig.LRegarding the steps from 200 to steps 207, we had 
described these within the Fig.l. 

FIG.5 (a), (b), (c) and (d) illustrate two set pairs of planar points patterns. 
Where one pair (Pattern A and Pattern B) are similar and another (Pattern C 
and Pattern D) are not. The coordinates and the feature directions of the points 
are listed in the tables. Among the patterns, Pattern A, the test pattern (FIG 
5(a)) is considered similar to Pattern B (FIG 5(b)), the reference pattern, their 
positions are shown in FIGS. 6(a) and (b) corresponding. After triangle coarse 
matching, filtering out the impossible matching points, the first four matched 
pairs with highest weighting value are found to be: 

(182, 157), (195, 111), (149, 227)(117, 157) (11) 

The remainder show in FIG 7(a) (test pattern) and (b) (reference pattern). By 
(11) and using (8), the translation and rotation parameters are found to be: 

h = 0.223 

h = -15.744 

ri = 1.000 (12) 

r 2 = 0.019. 



After translation and rotation conversion, the coordinate of the test pattern is 
shown in FIG 8(a). The weighting value W is: 



17 



W = J2 W * = 23946 (13) 

In this case, where represents the individual weight of the matched points. Ac- 
cording to (9), the average distance is: 

17 

Si = Yli( X new0 ~ Xrefp) 2 + (z n ew0 ~ ^re/js) 2 ] = 221.633 (14) 
0=1 



and 



5 - ^ - 13.03 (15) 
By (13), (14) and (15), the similarity is: 

5 - m= 239^© =7295 (lg) 

It considers to be a high similarity matching sets. Next, we show another non- 
similar case. The test pattern C (FIG 5(c)) is considered NOT similar to the 
reference Pattern D (FIG 5(d)), the reference pattern, their positions are shown 
in FIGS. 6(c) and (d) corresponding. After triangle coarse matching, filtering 
out the impossible matching points, the first four matched pairs with highest 
weighting value are found to be: 

(193, 105), (50, 80), (115, 36), (178, 200) (17) 

The remainder shows in FIG 7(c) (test pattern) and (d) (reference pattern). By 
(17) and using (8), the translation and rotation parameters are found to be: 

h = 22.517 
h = -20.239 

t x = 0.990 (18) 
r 2 = 0.143. 

After translation and rotation conversion, the coordinate of the test pattern is 
shown in FIG 8(b). The weighting value becomes: 

4 

W = Yl w i = 1745 < 19 ) 

In this case, where represents the individual weight of the matched points. Ac- 
cording to (9), the average distance is: 

4 

S I = £[(*ne«tf - XreffS? + (x new p - X ref pf] = 230.088 (20) 

0=1 



8 



and 



S = ^-= 57.52 
4 

By (19), (20)and (21), similarity is: 



(21) 




= 0.47. 



(22) 



From (22), the value of similarity indeed, is low. FIGS.8 illustrates how the 
results alter after converting coordinate process* FIG.8 (a) and (b) represent 
the coordinates of the similar test and reference patterns while FIG.8(c) and 
(d) show the non-similar pair; FIGS.9 illustrates the positions of the similar 
test pattern, as shown in FIG.9 (a), and the non-similar one, as shown in FIG.9 
(b), after the translation and rotation conversion about the two pair of planar 
points patterns; and In order to prove that the effects of this invention satisfies 
the high precision as we need, there are 2520 fingerprints in the database, 126 
fingers, each with 20 same fingerprints. The number of similar matching is: 
126*(20)*(20-l)=47880,every pattern obtained from a finger is matched with 
patterns from other fingers. The number of non-similar matching is: ((126- 
1)*20)*2520 =6300000,the results of the matching of patterns of 2520 finger 
prints obtained from 126 fingers is shown in FIG 10. The FBR of this invention 
is quit well. The above description only the framework of this invention. Those 
technology will be able to have further improvement and modification with the 
spirit and framework of this invention, but all such improvement or modification 
should be under the scope of this present invention. 
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